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Remarks/Arguments: 

Claims 1-12 have been amended. Claim 13 has been added. No new matter is 
introduced herein. Claims 1-13 are pending. 

Claim 1 has been amended to clarify that the method is a computer system 
implemented method of automatically computing from data received by a computer-based 
value appraising system an optimal appraisal value of a real estate property. Claim 1 has 
further been amended to clarify that steps (a), (b) and (d) are performed by the computer- 
based value appraising system. Finally, claim 1 has been amended to recite a step of 
outputting the optimal appraisal value to the user. Claims 2-11 have been amended to 
correspond with claim 1. Claim 12 has been amended to include computer-executable 
instructions, at least one data processor that executes the instructions and to recite "a 
computer-readable medium comprising computer-executable code for causing a processor to 
perform." No new matter is introduced herein. Support for the amendments include, for 
example, page 5, line 18-page 6, line 11; page 11, line 10-page 12, line 11; and page 15, 
line 18-page 18, line 18 of the substitute specification filed on October 14, 2003. 

Claims 1-12 have been rejected under 35 U.S.C. § 101 as being directed to non- 
statutory subject matter. Claim 1 has been amended, as discussed above, to recite a 
computer system implemented method and that steps (a), (b) and (d) are performed by a 
computer-based value appraising system. Claim 12 has been amended to include 
computer-executable instructions and "a computer-readable medium comprising computer- 
executable code for causing a processor to perform." 

On page 3 of the Office Action (relating to the § 101 rejection), the Examiner asserts 
that "Applicant's claimed invention is directed to a human calculating appraisal of a real 
estate [by] programming a programmable calculator with a nonlinear function, entering the 
data and generating an appraised value." Applicant respectfully disagrees. Applicant's 
claims 1 and 12 are directed to nonlinear programming of a nonlinear objective function to 
simultaneously optimize the nonlinear objective function for all of different types of 
appraisal approaches. As known to the skilled person, nonlinear programming is a 
complicated technique that attempts to minimize or maximize a function of several variables 
(i.e., an objective function) to determine an optimum solution to the objective function. The 
skilled person understands that, because of the complexity of nonlinear programming 
tprhniques, computers are tvoicallv u sed to implement nonlinear programming. For the 
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Examiner's convenience, a copy of U.S. 2001/0051936 to Michalewicz, which relates to 
nonlinear programming, is attached. Thus, the sl<illed person, upon reading Applicant's 
specification, would understand that Applicant's invention relates to a computer-based value 
appraising svstem and uses a processor to perform the nonlinear programming of the 
nonlinear objective function, as recited in Applicant's claims 1 and 12. Accordingly, 
Applicant respectfully requests that the rejection of claims 1-12 under 35 U.S.C. § 101 be 
withdrawn. 

Claims 1-12 have been rejected under 35 U.S.C. § 112, first paragraph, as failing to 
comply with the enablement requirement. In particular, the Examiner asserts that the 
"Specification, while being enabling for a human to perform nonlinear programming of a 
microprocessor ... does not reasonably provide enablement for microprocessor to perform 
the nonlinear programming." Applicant respectfully disagrees. Support for a processor 
performing the nonlinear programming is provided in the substitute specification at page 5, 
line 18-page 6, line 11; page 11, line 10-page 12, line 11; page 15, line 18-page 18, line 
18. Applicant also notes that, as discussed above, the skilled person understands that 
nonlinear programming is typically performed by a microprocessor, rather than by a human. 
Applicant again respectfully points the Examiner's attention to the attached Michalewicz 
reference. Accordingly, for the reasons set forth above. Applicant respectfully requests that 
the rejection of claims 1-12 under 35 U.S.C. § 112, first paragraph, be withdrawn. 

Claims 1-12 have been rejected under 35 U.S.C. § 112, second paragraph, as being 
unclear. In particular, it is asserted, on page 4 of the Office Action, that "it is not clear 
whether a human performs the programming of the microprocessor, or, microprocessor 
performs the programming of itself" and that Applicant "has not positively claimed if any 
action is performed with the generated appraisal of the real estate." As discussed above, 
claim 1 has been amended to clarify that the method relates to a computer system 
implemented method and that steps (a), (b) and (d) are performed by a computer-based 
value appraising system. Claim 1 has also been amended to clarify that the optimal 
appraisal value is output to the user. Claim 12 has been amended to include computer- 
executable instructions and "a computer-readable medium comprising computer-executable 
code for causing a processor to perform." Accordingly, Applicant respectfully requests that 
the rejection of claims 1-12 under 35 U.S.C. § 112, second paragraph be withdrawn. 

Claims 1-12 have been rejected under 35 U. S. C. § 103(a) as being unpatentable 
over Robbins (US 2001/0039506) in view of "Modern Real Estate Practice" by Galaty et al. 
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and Bradley et al. (U.S. 7,711,574). Reconsideration is respectfully requested for the 

reasons set forth below. 

Claim 1 includes features neither disclosed nor suggested by the cited art, namely: 

...where aN of different types of appraisal approaches are used 
together to optimize a nonlinear objective function... 

b) defining , by the computer-based value appraising system, 
the nonlinear objective function that includes co ntrol variables 
representing the stored influence factors for all of the different 
types of appraisal approaches : 

c) using and causing a microprocessor to perform nonlinear 
proa ramming of the nonlinear objective function to 
simultaneouslv optimize the nonlinear objective function for all 
of the different tvpes of appraisal approaches by adjusting the 
control variables within the corresponding range of influence 
factor values... (Emphasis Added) 

Claim 12 includes a similar recitation. 

Robblns teaches the determination of a real estate parcels market value through the 

application of the sales comparison approach to value (paragraph [0076]). In Figs. 3 and 4, 

Robblns teaches that a set of procedures are created to build property attribute databases 

and a set of procedures are created to apply the rules of appraisal to the property attribute 

databases in order to estimate the value of a subject property ([0105]). In Figs. 4 and 5, 

Robbins teaches the development of a sales condition score for individual parcels that may 

be used to suggest to the user a relationship between a comparable selling price and its 

attribute inventory (paragraphs [0133 - 0144]). Robblns also teaches that the invention 

assists In the reliability of the sales comparison approach by providing access to an 

increased number of substitute properties (paragraph [0080]). 

Robbins, however, does not teach: 1) defining a n onlinear objective function that 
includes control variables representing the stored Influence factors for all of the different 
types of appraisal approaches, 2) nonlinear proarammino to simultaneouslv optimize the 
nonlinear objective function for all of the different tvpes of appraisal approaches or 3) that 
aii of the different types of appraisal approaches are used tog ether to optimize the nonlinear 
objective function, as required by claims 1 and 12. Robblns is silent regarding these 
indicated features. 
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Robblns merely discloses, at paragraph [0080], that "an appraiser generally 
considers three separate approaches to value: the cost approach, the income approach, and 
the sales comparison approach" but that "the invention is specific to the sales comparison 
approach" (emphasis added). In other words, Robbins mentions that, in determining the 
market value of a subject property, an appraiser generally considers three separate 
appraisal approaches to value. However, Robblns does not disclose or suggest using these 
approaches together, but that the appraiser considers the appropriateness of the approaches 
to value In order to select the most appro priate approach (paragraph [0081]). Thus, 
Robbins does not Include all of the features of claims 1 and 12. 

Galaty et al. disclose that appraisers traditionally use the sales comparison 
approach, the cost approach and the Income approach, where the three methods serve as 
checks against each other (p. 304, last paragraph). At p. 305-p. 312, Galaty et al. disclose 
linear calculations for separately appraising value by each of the three methods. At p. 312, 
Galaty et al. teach that when the three approaches are applied to the same property, three 
separate Indications of value are produced. Reconciliation (based on the validity of each 
approach) Is then performed to produce a single estimate of the market value. Thus, as 
shown In Fig. 18.1, separate calculations for each of the different appraisal value 
approaches are performed and reconciled (i.e., after thev are separately calculated) to 
generate a single estimate of a market value. 

Galaty et al., however, do not disclose or suggest: 1) defining a nonlinear obiective 
function that includes control variables representing the stored Influence factors for all of the 
different types of appraisal approaches, 2) nonlinear programming to simultaneously 
optimize the nonlinear objective function for all of the different types of appraisal 
approaches or 3) that all of the different types of appraisal approaches are used together to 
optimize the nonlinear objective function, as required by claims 1 and 12. Galaty et al. are 
silent regarding these indicated features. 

At page 304, Galaty et al. only mention three separate appraisal approaches to value 
"as checks against each other" for narrowing "the range within which the final estimate of 
value falls." As discussed above, Galaty et al. only teach separately c alculating the property 
value, followed by a reconciliation process to produce a single estimate of the market value. 
Thus, Galaty et al. do not make up for the deficiencies of Robbins with respect to claims 1 
and 12. 
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Bradley et al. relate to systems and methods to determine an indication (such as a 
home value (HV) score) of whether a property appraisal is likely to be faulty. (Column 4, 
lines 6-22.) Bradley et al. disclose, in Fig. 12, a logistic regression approach to determine 
coefficients for the HV score model, based on historical information and verification of a first 
appraisal. Logistic regression models are used to examine how various factors influence a 
binary outcome. (Column 14, line 64-column 16, line 64.) 

Bradley et al., however, do not disclose or suggest: 1) defining a nonlinear objective 
function that includes control variables representing the stored influence factors for all of the 
different tvpes of appraisal approaches, 2) nonlinear programming to simultan eously 
o ptimize the nonlinear objective function for all of the different tvoes of appraisal 
approaches or 3) that aN of the different types of appraisal approaches are used together to 
optimize the nonlinear objective function, as required by claims 1 and 12. Bradley et al. are 
silent regarding these Indicated features. 

On page 6 of the Office Action, the Examiner asserts that "Robbins in view of Galaty 
does not teach what formula(e) it uses to determine appraised value of a real estate." 
Applicant respectfully disagrees. Galaty et al, provide specific examples and specific 
formulae for the sales comparison approach, the cost approach and the income approach. 
(See pages 305-312 of Galaty et al.) Bradley et al. describe logistic regression techniques 
to determine coefficients of an HV score model. However, none of the cited art disclose or 
■:;iiggp«;l- nonlinear programming and a nonlinear objective function. As described in 
Applicant's specification, and as known to the skilled person, nonlinear programming is a 
specific technique which maximizes or minimizes an objective function. These indicated 
features are completely absent from the cited art. 

Accordingly, none of the cited art, either alone or in combination, can teach: 1) 
defining a nonlinear objective function for all of t he different tvoes of appraisal approaches, 
2) nonlinear programming to simultaneouslv optimize the nonlinear objective function for all 
of the different types of appraisal approaches or 3) that aM of the different types of appraisal 
approaches are used together to optimize the nonlinear objective function, as required by 
claims 1 and 12. Thus, for the reasons set forth above, allowance of claims 1 and 12 is 
respectfully requested. 

Claims 2-11, which include all of the features of claim 1, are also patentable over 
the cited art for at least the same reasons as claim 1. 
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Claim 13 has been added. No new matter is introduced herein. Claim 13 is 
similar to claim 12. Claim 12 recites a processor coupled to at least one memory, where the 
"processor is programmed to perform the optimal appraisal by." Applicant also points the 
Examiner's attention to the Interim Examination Instructions for Evaluating Subject Matter 
Eligibility under 35 U.S.C. § 101, with respect to a product example of claimed judicial 
exception. For the Examiner's convenience, a copy of the Interim Examination instructions 
related to the Judicial Exception is attached. Claim 13 is patentable over the cited art for at 
least the same reasons as claim 12. 

In view of the amendments and arguments set forth above, the above-identified 
application is in condition for allowance which action is respectfully requested. 



LEA/kpc 
Attachments: 



Respectfully submitted, 
nerPrestia/. 




Interim Examination Instructions for Evaluating Subjetjt (Matter ^gibility 
Under 35 U.S.C. § 101 

U.S. Patent Application Publication US 2001/0051936[A1 toXichalewicz 



Dated: October 11, 2010 

P.O. Box 980 

Valley Forge, PA 19482 

(610) 407-0700 

The Director is hereby authorized to charge or credit Deposit Account No. 18-0350 for any additional fees, or any 
underpayment or credit for overpayment in connection herewith. 
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(57) ABSTRACT 

A method and system for relurning an optimum (or near- 
optimum) solution to a nonlinear programming problem. By 
specifying a precision coetScient, the user can influence the 
flexibility of the returned solution. A population of possible 
solutions is initialized based on input parameters defining 
the problem. The input parameters may include a minimum 
progress and a maximum number of iterations having less 
the minimum progress. The solutions are mapped into a 
search space that converts a constrained problem into an 
unconstrained problem. Through multiple iterations, a sub- 
set of solutions is selected from the population of solutions, 
and variation operators are applied to the subset of solutions 
so that a new population of solutions is initialized and then 
mapped. If a predetermined number of iterations has been 
reached, that is if the precision coeEBcient has been satisfied, 
the substantially optimum solution is selected from the new 
population of solutions. The system and method can be used 
to solve various types of real-world problems in the fields of 
engineering and operations research. 
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SYSTEM AND METHOD FOR DETERMINING AN 
OPTIMUM OR NEAR OPTIMUM SOLUTION TO A 
PROBLEM 



CROSS-REFERENCE TO RELATED 
APPLICATIONS 

[0001] This application claims priority to U.S. Provisional 
Application Ser. No. 60/198,643, filed on Apr. 20, 2000, the 
entire contents of which are herein incorporated by refer- 
ence. 

BACKGROUND 
[0002] 1. Field of the Invention 

[0003] The present invention generally relates to the field 
of nonlinear programming and, more particularly, the 
present invention relates to a system and method implement- 
ing nonlinear programming techniques to determine an 
optimum or near-optimum solution to a real-world problem. 
[0004] 2. Background Description 
[0005] Nonlinear programming is a technique that can be 
used lo solve problems thai can be put into a specific 
mathematical form. Specifically, nonlinear programming 
problems are solved by seeking to minimize a scalar func- 
tion of several variables subject to other functions that serve 
to limit or define the values of the variables. These other 
functions arc typically called constraints. The entire math- 
ematical space of possible solutions to a problem is called 
the search space and is usually denoted by the letter "S". The 
part of the search space in which the function to be mini- 
mized meets the constraints is called the feasibility space 
and is usually denoted by the letter "F". 
[0006] Nonlinear programming is a difficult field, and 
often many complexities must be conquered in order to 
arrive at a solution or "optimum" to a nonlinear program- 
ming problem. For example, some problems exhibit local 
"optima"; that is, some problems have spurious solutions 
that merely satisfy the requirements of the derivatives of the 
functions. However, nonlinear programming can be a pow- 
erful tool to solve complex real-world problems, assuming 
a problem can be characterized or sampled to determine the 
proper functions and parameters to be used in the nonlinear 
program. 

[0007] Due to the complexity of nonlinear programming 
techniques, computers are often used to implement a non- 
linear program. It should be noted that the term "program- 
ming" as used in the phrase "nonlinear programming" refers 
lo the planning of the necessary solution steps that is pari of 
the process of solving a particular problem. This choice of 
name is incidental to the use of the terms "program" and 
"programming" in reference to the list of instructions that is 
used to control the operation of a modem computer system. 
Thus, the term "NLP program" for nonlinear programming 
software is not a redundancy. 

[0008] Almost any type of problem can be characterized in 
a way that aUows it to be solved with the help of NLP 
techniques. This is because any abstract task to be accom- 
plished can be thought of as solving a problem. The process 
of solving such a problem can, in turn, be perceived as a 
search through a space of potential solutions. Since one 
usually seeks the best solution, this task can be characterized 



as an optimization process. However, nonlinear program- 
ming techniques are especially useful for solving complex 
engineering problems. These techniques can also be used to 
solve problems in the field of operations research (OR) 
which is a professional discipline that deals with the appli- 
cation of information technology for informed decision- 
making. 

[0009] The majority of numerical optimization algorithms 
for nonlinear programming are based on some sort of local 
search principle; however, there is quite a diversity of these 
methods. Of course, then, classifying them neatly into 
separate categories is difficult because there are many dif- 
ferent options. By example, some incorporate heuristics for 
generating successive points to evaluate, others use deriva- 
tives of the evaluation function, and still others are strictly 
local, being confined to a bounded region of the search 
space. But these numerical optimization algorithms all work 
with complete solutions and they all search the space of 
complete solutions. Most of these techniques make assump- 
tions about the objective function or constraints of the 
problem (e.g., linear constraints, quadratic function, etc), 
and most of these techniques also use some type of penalty 
function lo handle problem-specific constraints. 
[0010] One of the many reasons that there are so many 
different approaches to nonlinear programming problems is 
that no single method has emerged as superior to all others. 
In general, it has been thought impossible to develop a 
deterministic method for finding the best global solution in 
many situations that would be better than an exhaustive 
search. There is thus a need for a method and system that can 
be used to find optimal or near-optimal solutions for almost 
any nonlinear programming problem. Ideally, the method 
and system should be able to handle both linear and non- 
Hnear constraints. 

SUMMARY 

[0011] The present invention can be used to find an 
optimal (or near-optimal) solution to any nonlinear program- 
ming problem. The objective function need not be continu- 
ous or differentiable. The method and system according to 
the present invention will return the optimum (or near- 
optimum) solution which is feasible (i.e., it satisfies prob- 
lem-specific constraints). 

[0012] According to the method of the present invention, 
a population of possible solutions is initialized based on 
input parameters defining the problem. The input parameters 
may include, for example, a minimum progress and a 
maximum number of iterations having less the minimum 
progress (where the minimum progress may be the precision 
coefficient). The solutions are mapped into a search space by 
a decoder. For most problems the input parameters also 
include such features as, for example, all variables of the 
problem, the domains for the variables, the formula for the 
objective function, and the constraints (linear and nonlin- 
ear). 

[0013] After mapping the problem into a search space 
(which converts the constrained problem into an uncon- 
strained problem) the method of the present invention then 
proceeds by repeatedly selecting a subset of solutions from 
the population of solutions, applying variation operators to 
the subset of solutions so that a new population of solutions 
is initialized, and mapping the new population of solutions 
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into the search space. Finally, when termination condition is 
satisfied (e.g., the maximum number of iterations having 
less than the minimum progress has been reached, i.e., if the 
precision coefficient has been satisfied), the substantially 
optimum .solution is selected from the new population of 
solutions. This solution can be .supplied to a file for later 
retrieval, or supplied directly into another computerized 
process. The variation operators mentioned above include 
both unary and binary operators. 

[0014] A computer software program or hardwired circuit 
can be used to implement the present invention. In the case 
of software, the program can be stored on media such as, for 
example, magnetic media (e.g., diskette, tape, or fixed disc) 
or optical media such as a CD-ROM. Additionally, the 
software can be supphed via the Internet or some other type 
of network. A workstation or personal computer that typi- 
cally runs the software includes a plurality of inpul/output 
devices and a system unit that includes both hardware and 
software necessary to provide the tools to execute the 
method of the present invention. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[0015] FIG. 1 shows a flowchart which illustrates the 
method of the present invention; 

[0016] FIG. 2 is a diagram illustrating how a space is 
mapped into a cube in order to initialize a search space 
according to the invention; 

[0017] FIG. 3 illustrates the influence of the location of a 
reference point on a transformation according to the inven- 

[0018] FIG. 4 shows a line segment of a non-convex space 
that follows from the mapping of the present invention; 

[0019] FIG. 5 is a diagram that illustrates mapping &om 
a cube into a convex space according to the invention; 

[0020] FIG. 6 shows a line segment in a non-convex space 
and con-esponding sub-inteivals resulting from mapping 
which is implemented according to the present invention; 

[0021] FIG. 7 illustrates a workstation on which the 
present invention is implemented; and 

[0022] FIG. 8 illustrates fiirther detail of an embodiment 
of hardware for implementing the system and method of the 
present invention. 

DETAILED DESCRIPTION 

[0023] The present invention is directed to optimally or 
near-optimally providing solutions to complex real-world 
problems which may be encountered in any number of 

situations. By way of illustration and not to limit the present 
invention in any manner, a type of problem that the system 
and method of the present invention may solve is a design 
engineering problem such as the de.sign of an engine which 
is modeled by an array of parameters (e.g., 100 different 
variables) such as pressures, lengths, component type and 
the like. These parameters may be labeled Xj, x^, . . . Xjoq. 
In providing a solution to this and other problems, the 
present invention will minimize some very complex objec- 
tive that is given as a formula of these 100 variables, or as 
a procedure to execute using these 100 variables. 



[0024] Also, in this specific illustration there may also be 
problem-specific constraints. For example, the total of three 
dimensions (e.g., X4, X5, and x^) of a particular part on the 
engine may have to be designed 10 stay between 10 and 15. 
This constraint may be modeled as a pair of linear con- 
straints such that: 

x^+Xs+x^^lOf and 

[0025] Similarly, it is possible to have nonlinear con- 
straints (e.g., a volume should stay within some limit). Thus, 
the problem can be specified by the objective function, the 
variables, their domains, and a set of constraints. 

[0026] The general nonlinear programming (NLP) prob- 
lem is to find X so as to: 

oplimize 7{x^ .... x,)tW, 

[0027] where iTeFcw". The objective function "f is 
defined on the search space Scji" and the set FcS defines the 
feasible region. Usually, the search space S is defined as an 
n-dimensional rectangle in si" (domains of variables defined 
by their lower and upper bounds): 

t(i)SxiSu(f), ISiSn, 

[0028] whereas the feasible region FcS is defined by a set 
of m additional constraints (m^O): 

gi(7)S0, for;=], . . . , 9, and Aj(7).0, fo,j=q*^, . . 

[0029] It is a common practice to replace the equation hj( 
■3r)"0 with a set of inequalities, hj(ir)^ 8 and hj('x)l-8 for 
some small 5>0. Throughout the remaining portions of the 
disclosure, it is assumed that the above holds true. 
[0030] Consequently, the set of constraints consists of m 
inequalities gj( x ) = 0, for j=l, . . . , m. After replacement of 
the equations with pairs of inequalities, the total number of 
inequality constraints is actually q+2 (m-q)=2m-q. How- 
ever, to simplify the notation, it is assumed there are m 
inequality constraints. At any point x eF, the constraints gj 
that satisfy gj(ir)-0 are called the active constraints at "x . 
[0031] The NLP problem has often been thought of as 
intractable; that is, it is impossible to develop a deterministic 
method for the NLP in the global optimization category, 
which would be better than an exhaustive search. However, 
this makes room for the system and method of the present 
invention extended by some constraint-handling methods 
such as described herein in accordance with the present 
invention. The evolutionary method and system of the 
present invention uses specialized operators and a decoder. 
The decoder is based on the transformation of a constrained 
problem to an unconstrained problem via mapping. This 
method has numerous advantages, including, not requiring 
additional parameters, not having a need to evaluate or 
penalize infeasible solutions, and easiness of approaching a 
solution located at the edge of a feasible region. 
[0032] As previously mentioned, specialized operators are 
used to implement the invention. These operators "assume" 
that the search space is convex. The domain D is defined by 
ranges of variables (Ik^x^Sr^ for k=l, ... n) and by a set 
of constraints C. From the convexity of the set D it follows 
that for each point in the search space (Xj xJeD there 
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exists a feasible range {left(k), right(k)} of a variable 
x^O^kSn), where other variables XjO-l, . . . , k-l,k+l, . . . 
n) remain fixed. In other words, for a given (Xj, . , . , x^, . . . , 
xJeD: 

;V£{te^it)^i«A<*)}iSi;at^ .... x„_^ y, x^^„ x^D, 

[0033] where all x,'s (i=l, . . . , k-l,k+l, . . . , n) remain 
constant. We assume also that the ranges {left(k), right(k)} 
can be efGcieatly computed. 

[0034] If the set of constraints C is empty, then the search 
space D=Hk_i"{lk, r,,} is convex; additionally left(k)-l^ 
right(k)=ri. for k=l, . . . n. Therefore, the operators constitute 
a valid set regardless of the presence of the constraints. 

[0035] Several operators based on floating point represen- 
tation are used with the invention. The first three are unary 
operators, each representing a category of mutation. The 
other three operators are binary operators, representing 
various types of crossovers. The operators are discussed 

[0036] Uniform Mutation 

[0037] This operator requires a single parent x and pro- 
duces a single offspring x '. The operator selects a random 

component ke(l, . . . , n) of the vector "x -(Xj, . . . , x^ 

X J and produces x"'-(Xi x'^ xj, where x'j, is a 

random value (uniform probability distribution) from the 
range {left(k), right(k)}. 

[0038] Boundary Mutation 

[0039] This operator also requires a single parent x and 
produces a single offspring "x '. The operator is a variation of 
the uniform mutation with xV being either left(k) or right(k), 
each with equal probability. The operator is constructed for 
optimization problems where the optimal solution lies either 
on or near the boundary of the feasible search space. 
Consequently, if the set of constraints C is empty, and the 
bounds for variables are quite wide, the operator is a 
nuisance. But this operator can prove extremely useful in the 
presence of constraints. 

[0040] Non-uniform Mutation 

[0041] This is a unary operator responsible for the fine 
tuning capabilities of the system and method of the present 
invention. The operator is defined as follows. For a parent 
"x, if the element x^ was selected for this mutation, the result 
is "x '={xj, . . . x'k, . . . , X,}, where: 




[ Xi + righi(/t) - Xi) if a random binary digit is 0 
[ xt - xt - lefK*)) it a random binary digil is 1 . 



[0042] The function A(t,y) returns a value in the range 
[0,y] such that the probability of A(t,y) being close to 0 
increases as t increases (t is the generation number). This 
property causes this operator to search the space uniformly 
initially (when t is small), and very locally at later stages. 
A(t,y) can be specified by the following function: 



A(/.y)=>/-(l-yf, 

[0043] where r is a random number from [0..1], T is the 
maximal generation number, and b is a system parameter 
determining the degree of non-uniformity. 
[0044] Arithmetical Crossover 

[0045] This binary operator is defined as a linear combi- 
nation of two vectors. If 'xj and X2 are crossed, the 
resulting offspring are: 

■? -..a x.+P-B) *, and "?'j-bx,+(1-<i) x,. 
[0046] This operator uses a random value ae[0..1], as it 
always guarantees closedness ( x '1, x jeD). 
[0047] Simple Crossover 

[0048] This is a binary operator such that if x i-(Xj 

xj and "x2=(y„ . . . , y J are crossed after the k-th position, 
the resulting offspring are: 

X \=(.x„ . . . A»i >») »nd x''2=()'i. ■•■yu 

. . . , xj. 

[0049] Such an operator may produce offspring outside the 
domain D. To avoid this, the present invention uses the 
property of the convex spaces stating that there exists ae[0,l] 
such that: 

7\+lxy . . . , Xfc yttio+^ttiCl-") y, «*x-(l-a)} 

[0050] and 

■x'2-{yi, •■■.>], JtkrfO+j'k.iCi-a) ■»o'>+y.(i- 

«)} 

[0051] are feasible. 
[0052] Heuristic Crossover 

[0053] This operator is a imique crossover for the follow- 
ing reasons: (1) it uses values of the objective function in 
determining the direction of the search, (2) it produces only 
one offspring, and (3) it may produce no offspring al all. This 
operator generates a single offspring x 3 from two parents, 
iTj and iTj according to the following rule: 

[0054] where r is a random number between 0 and 1, and 
the parent "x ^ is no worse than iTj, i.e., fC^^^fCxi) for 
maximization problems and /( x 1)= j'( x j) for minimiza- 
tion problems. 

[0055] It is possible for this operator to generate an 
offspring vector which is not feasible. In such a case another 
random value r is generated and another offspring is created. 
If after w attempts no new solution meeting the constraints 
is found, the operator stops and produces no of&pring. The 
heuristic crossover contributes towards the precision of the 
solution found, where its major responsibilities are (1) fine 
local tuning and (2) searching in the promising direction. 
[0056] However, it is necessary to be able to handle cases 
where the feasible search space is not convex. In order for 
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the present invention to be able to handle such cases, a 
decoder is used. In techniques based on decoders, a chro- 
mosome "gives instructions" on bow to build a feasible 
solution. For example, a sequence of items for the classic 
knapsack problem can be interpreted as: "take an item if 
possible," Such an interpretation would lead always to a 
feasible solution. 

[0057] Several factors should be taken into account while 
using a decoder. A decoder imposes a mapping T between a 
fea,sible solution and decoded solution. It is imporlanl thai 
this mapping satisfies several conditions. First, for each 
solution seF there must be an encoded solution d. Also, each 
encoded solution d should correspond to a feasible solution 
s. All solutions in F should be represented by the same 
number of encodings d. Additionally, it is reasonable to 
expect that the transformation T is computationally fast and 
that it has a locality feature in the sense that small changes 
in the coded solution result in small changes in the solution, 
itself. 

[0058] Now understanding the above, FIG. 1 shows a 
flowchart illustrating the method of the invention using a 
decoder which meets all the above requirements and the 
variation operators as described above. It should be well 
understood by those of ordinary skill in the art that FIG. 1 
may equally represent a high level system block diagram of 
the present invention. 

[0059] At step 101, input data is organized into modules. 
These modules may be created manually, or created by 
another program or routine in the computer software that is 
implementing the invention. In embodiments, one module 
includes the number of variables, their domains, and all 
linear constraints. In embodiments, another module includes 
the objective function, while a third module includes all 
nonlinear constraints. 

[0060] At step 102, a population of solutions is initialized. 
That is, a number of potential solutions to the problem are 
generated by the method of the present invention. All 
solutions are vectors of floating point numbers. Each com- 
ponent of each vector is a number from the range [0..1]. At 
step 103, the decoder of the present invention initially maps 
the solutions into a search space. It is noted that each 
individual solution is mapped into a feasible solution &om 
the real search space. The mechanism of this mapping is 
further described below. 

[0061] Steps 104 through 107 describe the iterations that 
take place after the initial mapping in order to reach a final 
solution to the problem. At step 104, a termination condition 
is described. For example, if there have been "k" iterations 
with progress less than e (the precision coefficient), the 
process stops and the current solution is returned at step 108. 
Initially, there have been no iterations, so steps 105-107 are 
performed until there have been "k" iterations. At step 105, 
a subset of solutions from the search space is selected 
according to a biased probability distribution, where better 
solutions have better chances for selection. One or more of 
the variation operators are applied to the subset at step 106 
to arrive at a new, smaller population of solutions. The input 
file specifies the operators and their frequency. These new 
solutions are then mapped into the search space at step 107, 
and the process repeats until the condition at step 104 is met 
and the best or most optimum solution is returned at step 
108. The returned best solution can be presented on a screen. 



stored in a file, or a numerical description of the solution can 
serve as input to another program or computerized process. 
[0062] The mapping process and the decoder can be most 
readily understood by examining a nonlinear programming 
process. FIG. 2 shows a one-to-one mapping between an 
arbitrary convex feasible search space F and an n-dimen- 
sional cube [-1,1]"- An arbitrary (different than point: 
y „=fr».., ■ ■ ■ . yo.„)^[-i,i]" 

[0063] defines a line segment from the vector 'S' to the 
boundary of the cube. This segment is described by: 

yi-yo.l-t, fo' >-l. • • • . " where 

[0064] t varies from 0 to t„.„=l/max {|yo,i|, . • ■ , |yo,„|}- 

For t-O, and for t=t„„, "y =(yo.it„,„ yo.„tmax) » 

boundary condition of the [-1,1]" cube is represented. Con- 
sequently, the corresponding feasible point x qeF is defined 



[0065] where T-t„^t„„, and v., is determined with 
arbitrary precision by a binary search procedure such thai 

[0066] is a boundary point of the feasible search space F. 
This mapping satisfies all the previously mentioned require- 
ments for the decoder. 

[0067] Apart from being one-to-one, the transformation is 
fast and has a locality feature. The corresponding feasible 
point IToeF is defined with respect to some reference point 
Tq. Such a reference point is an arbitrary internal point of 
the convex set F. Note that convexity of the feasible search 
space is not necessary, but it is sufBcient to assume the 
existence of the reference point Tq such that every line 
segment originating in Tq intersects the boundary of F at 
precisely one point. This requirement is satisfied for any 
convex set F. 

[0068] This approach may be extended by the additional 
method of iterative solution improvement according to the 
present invention. The iterative solution improvement of the 
present invention is based on the relationship between the 
location of the reference point and the efficiency of the 
proposed approach. It is clear that the location of the 
reference point has an influence on "deformation" of the 
domain of optimized function. The present invention opti- 
mized some other function which is topologically equivalent 
to the original function. For example, consider the case, 
shown in FIG. 3, where the reference point is located near 
the edge of the feasible region F. It is easy to notice a strong 
irregularity of transformation T. The part of the cube [-1,1]^, 
which is on the left side of the vertical line, is transformed 
into a much smaller part of the set F than the part on the right 
side of this line. 

[0069] According to the above considerations, it is prof- 
itable to localize the reference point in the neighborhood of 
the expected optimum, if this optimum is close to the edge 
of the set F. In such case the area between the edge of F and 
the reference point Tq is explored more precisely. 
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[0070] In the case of lack of information about approxi- 
mate localization of the solution, the reference point is 
placed close to the geometrical center of the set F. This can 
be done by sampling set F and selling: 



[0079] If the feasible search space F is convex, then the 
above line segment intersects the boundary of F in precisely 
one point, for some Iq e[0,l]. Consequently, for convex 
feasible search spaces F, it is possible to establish a one-to- 
one mapping (t):[-l,l]'' as follows: 



[0071] where x ; consists of samples from F. It is also 
possible to take advantage of the mentioned effect for the 
purpose of iterative improvement of the best-found solution. 
To obtain this effect it is necessary to repeat the optimization 
process with a new reference point r 'o which is located on 
a line segment between the current reference point r q and 
the best solution found to this point: 

[0072] where te(0,l] is close to zero. This change of the 
location of the reference point causes the found optimum to 
be explored more precisely in the next iteration in the 
neighborhood in comparison with the remaining part of the 
feasible region. Experiments have show that such a method 
usually provides good results for problems with optimal 
solutions locahzed on the edge of the feasible region. 

[0073] The approach of the present invention can be also 
extended to handle non-convex search spaces (the original 
nonlinear programming problem). That is, the proposed 
technique of the present invention can handle arbitrary 
constraints for numerical optimization problems. The task is 
to develop a mapping <j), which transforms the n-dimensional 
cube [-l.ir into the feasible region F of the problem. Note, 
that F need not be convex; it might be concave or even can 
consist of disjoint (non-convex) regions. 

[0074] As shown in FIG. 4, this mapping i|i is more 
complex than T defined earlier. Note that in FIG. 4 any line 
segment L which originates at a reference point r qcF may 
intersect a boundary of the feasible search space F in more 
than just one point. 

[0075] Because of the complexity of this mapping, it may 
be necessary to take into account the domains of the vari- 
ables. First, an additional one-to-one mapping g between the 
cube [-1,1]" and the search space S is defined (the search 
space S is defined as a Cartesian product of domains of all 
problem variables). Then the mapping g: [-1,1]°-*S can be 
defined as: 

[0076] where 



[0077] Indeed, for yj^-l the corresponding Xi=l(i), and for 
y~l the corresponding x,=u(i). 

[0078] A fine segment L between any reference point 
TqcF and a point at the boundary of the search space S, 
is defined as: 



[0080] where r oeF is a reference point, and y„.,i=maXi_ 
i"|y,|. FIG. 5 illustrates the transformation. That is, FIG. 5 
shovre a mapping ^ from the cube [-1,1]° into the convex 
space F (two-dimensional case), with the particular steps of 
the transformation. 

[0081] Returning now to the general case of arbitrary 
constraints (i.e., non-convex feasible search spaces F), con- 
sider an arbitrary point ye[-l,l]" and a reference point, 
TocF. Aline segment L between the reference point r □ and 
the point T=g(3r/y^,J at the boundary of the search space 
S, is defined as before: 

i(To 7;.To+f(7-7o), foros/si, 
[0082] However, the line segment may intersect the 
boundary of F in many points as shown in FIG. 4. In other 
words, instead of a single interval of feasibility [0,to] for 
convex search spaces, there may be several intervals of 
feasibility: 



[0083] It is assumed that there are altogether k sub- 
intervals of feasibility for such a line segment and tj's mark 
their limits. FIG. 6 shows a line segment in a non-convex 
space F and corresponding intervals for a two-dimensional 
case. As shown in FIG. 6: 



[0084] Thus, it is necessary to introduce an additional 
mapping y. which transforms interval [0,1] into the sum of 
intervals [t2i_i,l2i]- However, such a mapping y rather 
between [0,1] and the sura of intervals {l^i-i-hii ^ follows: 



LCto ?J.V„+»-(T+7'„,forOS«Sl. 



[0085] Note that, due to this change, the left boundary 
point is lost. This is not a serious problem, since the lost 
points can be approached with arbitrary precision. However, 
there are important benefits to this definition. It is possible 
to "glue together" intervals which are open at one end and 
closed at another end. Additionally, such a mapping is 
one-to-one. There are many alternatives for defining such a 
mapping. For example, a reverse mapping: 

[0086] can be defined as follows: 
6(')=('-'2i-i+Zi-.'-^-W 

[0087] where dj-tjj-t^j.i, d-2j.i''dj, and t2i_j<tSt2i. The 
mapping y is reverse of 8: 
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a-<!('2j-i) 



[0088] where j is the smallest index such that aS8(t2i). 
[0089] From the above, the general decoder mapping ^ is 
defined which is used as shown in FIG. 1 for the transfor- 
mation of constrained optimization problem to an uncon- 
strained optimization problem for every feasible set P. The 
mapping ^ is given by the formula: 




\h*'o igG/yw«)-h) if 5*0, 



[0090] where "ToeF is a reference point, ymax=maXi.i"|yi|, 
and to^(|yn„J). 

[0091] Finally, it is necessary to consider a method of 
finding points of intersection tj as shown in FIG. 6. This is 
relatively easy for convex sets, since there is only one point 
of intersection. For non-convex sets, however, the problem 
is more complex. 

[0092] In the embodiments of the invention, the following 
approach has been used to find the points of intersection for 
the non-convex sets. Consider any boundary point s of S 
and the hne segment L determined by this point and a 
reference point T'^tP- There are m constraints gi(ir)§0 and 
each of them can be represented as a function p; of one 
independent variable t for a fixed reference point T^V and 
the boundary point T of S: 

m'gi{l'{Jo^)'Sii'<'a*'<^-'^)). OS'S! »"<i 

[0093] As stated earlier, the feasible region need not be 
convex so it may have more than one point of intersection 
of the segment L with the boundaries of the set F. Therefore, 
the interval [0,1] is partitioned into v subintervals [Vj_],v], 

Vj-vj.,.i/v(i§ysv), 
[0094] so that equations Pi(t)=0 have, at most, one solution 
in every subinterval. The density v of the partition is 
adjusted experimentally. For all cases discussed in this 
disclosure v=20. In this case the points of intersection can be 
determined by a binary search. Once the intersection points 
between a line segment L and all constraints gi( x )^0 are 
known, one can then determine intersection points between 
this hne segment L and the boundary of the feasible set F. 
The flexibility of the solution is achieved by evaluating a 
solution in a particular way. That is, several solutions in the 
neighborhood of the current solution, as determined by the 
precision coefEcient, are evaluated and averaged. The com- 
putotional method handles both linear and nonlinear con- 
straints, and this is capable of handling convex and non- 
convex feasible search spaces in an eflSdent manner in 
accordance with the method and system of the present 



[0095] As previously mentioned, it is convenient to 
execute the method described above on a computer system 
which has been programmed with appropriate software. 
FIG. 7 illustrates a workstation on which the method of the 
present invention can be executed. Input/output (I/O) 
devices such as keyboard 702, mouse 703 and display 704 
are used by an operator to provide input and view informa- 
tion related to the operation of the invention. A system unit 
701 is connected to all of the I/O devices and contains 
memory, media devices, and a central processing unit 
(CPU), all of which together may execute the method of the 
present invention. These devices in combination with the 
appropriate software are the means for carrying out the 
various .steps involved in implementing the method of the 
present invention. 

[0096] As previously mentioned, appropriate computer 
program code in combination with the appropriate hardware 
may be used to implement the method of the present 
invention invention. This computer program code is often 
stored on storage media such as a diskette, hard disk, 
CD-ROM, DVD-ROM or tape. The media can also be a 
memory storage device or collection of memory storage 
devices such a read-only memory (ROM) or random access 
memory (RAM). Additionally, the computer program code 
can be transferred to a workstation over the Internet or some 
other type of network. The method of the present invention 
can equally be hardwired into a circuit or computer imple- 
menting the steps of the present invention. 

[0097] FIG. 8 illustrates further detail of the system unit 
for the computer system shown in FIG. 7. 'ITie system is 
controlled by microprocessor 802, which serves as the CPU 
for the system. System memory 805 is typically divided into 
multiple types of memory or memory areas, such as read- 
only memory (ROM), random-access memory (RAM) and 
others. If the workstation is an IBM compatible personal 
computer, for example, the system memory also contains a 
basic input/output system (BIOS). A plurality of general 
input/output (I/O) devices 806 such as a keyboard or a 
mouse are connected to various devices including a fixed 
disk 807, a diskette drive 809 and a display 808. The system 
may include another I/O device, a network adapter or 
modem, shown at 803, for connection to a network 804. This 
network connection may be used to download the software 
implementing the present invention for execution on the 
computer system. A system bus 801 interconnects the major 
components 802, 803, 805 and 806 of FIG. 8. 

[0098] It should be noted that the system as shown in 
FIGS. 7 and 8 is meant as an illustrative example only and 
should not be considered as a limiting factor in determining 
the scope of the present invention. For example, the present 
invention may be implemented on numerous types of gen- 
eral-purpose computer systems running operating systems 
such as Windows™ by Microsoft and various versions of 
UNIX and the like. 

EXAMPLE OF USE 

[0099] The present invention is particularly useful in 
workflow management problems, process problems, and 
engineering problems. By way of illustrative example, 
asstune that the optimization model of a particular engineer- 
ing problem is as follows: 
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[0100] Minimize 



0 < 85.334407 + O.OOeSStozJs + 0.0006262Ari;£i - 0.0022053i3J:5 £ 92 
905 80.51249 + 0.0071317.t2*3 + 0.0029955j:i*2 + 0.0021gI3l^ s 110 
20 s 9.300961 + 0.004702fa3.i3 + 0.0012547j(i jrj + 0.0019035a[3Jt4 £ 25, 

[0101] For this particular function, the optimum solution 
is (7).(78.0, 33.0, 29.995, 45.0, 36.776), with F( 
T)=-30665.5. Two constraints (upper bound of the first 
inequality and the lower bound of the third inequality) are 
active al the optimum. Note, however, that for most real 
problems this is not the case, i.e., neither the optimum 
solution nor the number of active constraints is known. The 
only reason for selecting the function F, as an example, is to 
underline the quality of the present invention. 
[0102] Al this stage, the system and method of the present 
invention can be used to find the best solution. The user then 
sets some parameters of the system such as, for example, 
population size, frequencies of operators, termination con- 
ditions (e.g., 5,000 generations) and the like. The system and 
method of the present invention then determines a feasible 
point (by random sampling of the search space) which will 
take a role of the reference point Tq (i.e., the first randomly 
generated feasible point was accepted as a reference point). 
Utilizing the above discussion, the present invention finds a 
solution of value -30664.5, which is a 0.0033 of one percent 
error. This is the optimum solution which is provided by the 
present invention. 

[0103] It cannot be overemphasized that the practical 
applications of the present invention are almost unlimited. 
For example, the present invention can provide solutions to: 

[0104] structural design systems; 

[0105] flaw detection in engineered structures; 

[0106] multiprocessor scheduling in computer net- 
works; 

[0107] physical design of integrated circuits; 

[0108] scheduling activities for an array of different, 
diverse systems; 

[0109] radar imaging; and 

[0110] mass customization, to name just a few. 
[0111] While the invention has been described in terms of 
several embodiments, those skilled in the art will recognize 
that the invention can be practiced with modification within 
the spirit and scope of the appended claims. The following 
claims are in no way intended to limit the scope of the 
invention to specific embodiments. 

1. A method of finding a substantially optimal solution to 
a constrained problem, the method comprising the steps of: 
initializing a population of possible solutions based on 

input parameters defining a problem; 
mapping the population of possible solutions into a search 



selecting a subset of solutions from the population of 

possible solutions; 
applying at least one variation operator to the subset of 

solutions in order to provide a new population of 

solutions; 

mapping the new population of solutions into the search 
space; 

repeating the selecting, applying and mapping the new 
population of solutions steps until a termination con- 
dition is satisfied; 

selecting the substantially optimum solution from the new 
population of solutions. 

2. The method of claim 1, wherein the termination con- 
dition is one of the input parameters. 

3. The method of claim 2, wherein the termination con- 
dition is based on a minimum progress and a maximum 
number of iterations having less the minimum progress. 

4. The method of claim 3, wherein 

the selecting the subset of solutions from the population 
of solutions step is performed when the maximum 
number of iterations having less than the minimum 
progress has not been reached; and 

the selecting of the substantially optimum solution step is 
performed when the maximum number of iterations 
having less than the minimum progress has been 
reached. 

5. The method of claim 1, wherein the selecting the 
substantially optimum solution step is performed after the 
repeating step. 

6. The method of claim 1, further comprising organizing 
input data into modules prior to the initializing step, the 
optimum solution being based on the input data. 

7. The method of claim 6, wherein the modules are 
separated into a plurality of modules, wherein: 

a first of the plurality of modules including a number of 

variables, domains and linear constraints associated 

with the input data; 
a second of the plurality of modules includes an objective 

function associated with the input data; and 
a third of the plurality of modules includes nonlinear 

constraints associated with the input data. 

8. The method of claim 1, wherein the mapping the 
population of possible solutions into a search space converts 
the constrained problem into an unconstrained problem. 

9. The method of claim 1, wherein the at least one 
variation operator is two or more variation operators. 

10. The method of claim 1 wherein the at least one 
variation operator includes both unary and binary operators. 

11. The method of claim 10, wherein the unary and binary 
operators are selected from the group of a uniform mutation 
operator, boundary mutation operator, non-uniform muta- 
tion operator, arithmetical crossover operator, simple cross- 
over operator and heuristic crossover operator 

12. The method of claim 1, wherein the optimum solution 
is displayed to a user. 

13. The method of claim 1, wherein the selecting a subset 
of solutions from the population of possible solutions 
includes the step of locating a substantial geometric center 
of the population of possible solutions. 
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14. A method of finding a substantially optimal solution to 
a constrained problem, the method comprising the steps of: 

initializing a population of solutions based on input 
parameters defining a problem, the input parameters 
including a minimura progress and a maximum number 
of iterations having less the minimum progress; 

mapping the population of solutions into a search space so 
that the constrained problem is converted into an 
unconstrained problem; 

selecting a subset of solutions from the population of 
solutions if the maximum number of iterations having 
less than the minimum progress has not been reached; 

applying variation operators to the subset of solutions so 

that a new population of solutions is initialized if the 

subset of solutions has been selected; 
mapping the new population of solutions into the search 

space if the new population of solutions has been 

initialized; and 
selecting the substantially optimum solution from the new 

population of solutions if the maximum number of 

iterations having less than the minimum progress has 

been reached. 

15. The method of claim 14, wherein the variation opera- 
tors include both unary and binary operators. 

16. An apparatus for finding a substantially optimal solu- 
tion to a constrained problem, the apparatus comprising: 

means for mapping a population of solutions into a search 
space so that the constrained problem is converted to an 
unconstrained problem; 

means for creating an initial population of solutions based 
on input parameters defining the problem; 

means for iteratively selecting a subset of solutions from 
a population of solutions; 

means for iteratively applying at least one variation 
operator to the subset of solutions in order to provide a 
new population of solutions; and 

means for selecting the substantially optimum solution 
from the new population of solutions after a termina- 
tion condition is satisfied. 

17. The apparatus of claim 16, wherein the termination 
condition is an input parameter which is based on a mini- 
mum progress and a maximum number of iterations having 
the minimum progress. 

18. The apparatus of claim 17, further comprising means 
for determining if the predetermined maximum iterations 
has been reached, the predetermined maximum iterations is 
equal to the maximum number of iterations having less than 
the minimum progress. 

19. A computer program product for enabling a computer 
system to find a substantially optimal solution to a con- 



strained problem, the computer program product including a 
medium with a computer program embodied thereon, the 
computer program comprising: 
computer program code for mapping a population of 

solutions into a search space so that the constrained 

problem is converted into an unconstrained problem; 
computer program code for creating an initial population 

of solutions based on input parameters defining the 

problem, the input parameters including a minimum 

progress and a maximum number of iterations having 

the minimum progress; 
computer program code for selecting a subset of solutions 

£rom a population of solutions; 
computer program code for applying variation operators 

lo the subset of solutions so thai a new population of 

solutions is initialized; 
computer program code for determining if the maximum 

number of iterations having less than the minimum 

progress has been reached; and 
computer program code for selecting the substantially 

optimum solution from the new population of solu- 

20. The computer program product of claim 19, wherein 
the variation operators include both unary and binary opera- 

21. A programmed computer system which is operable to 
find a substantially optimal solution to a constrained prob- 
lem by performing the steps of: 

initializing a population of solutions based on input 
parameters defining the problem, the input parameters 
including a minimum progress and a maximum number 
of iterations having the minimum progress; 

mapping the population of solutions into a search space so 
that the constrained problem is converted into an 
unconstrained problem; 

selecting a subset of solutions from the population of 
solutions if the maximum number of iterations having 
less than the minimum progress has not been reached; 

applying variation operators to the subset of solutions so 
that a new population of solutions is initialized if the 
subset of solutions has been selected; 

mapping the new population of solutions into the search 
space if the new population of solutions has been 
initiahzed; and 

selecting the substantially optimum solution from the new 
population of solutions if the maximum number of 
iterations having less than the minimum progress has 
been reached. 



